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Abstract. We consider stochastic equations of the form Xj^ = <t>k{^k+i)^k) 
fc S N, where and Zj. are random variables taking values in a compact 
group Gj., 4'k '■ Gk+i — >■ Gfc is a continuous homomorphism, and the noise 
{Zk)kevi 3. sequence of independent random variables. We take the sequence 
of homomorphisms and the sequence of noise distributions as given, and in- 
vestigate what conditions on these objects result in a unique distribution for 
the "solution" sequence {Xk)k£n and what conditions permits the existence 
of a solution sequence that is a function of the noise alone (that is, the solu- 
tion does not incorporate extra input randomness "at infinity"). Our results 
extend previous work on stochastic equations on a single group that was orig- 
inally motivated by Tsirelson's example of a stochastic differential equation 
that has a unique solution in law but no strong solutions. 



1. Introduction 

The following stochastic process was considered by Yor in |Yor92j in order to 
clarify the structure underpinning Tsirelson's celebrated example |Cir75| of a sto- 
chastic differential equation that does not have a strong solution even though all 
solutions have the same law. 

Let T be the usual circle group; that is, T can be thought of as the interval 
[0, 1) equipped with addition modulo 1. Suppose for each fc e N that ^fe is a Borel 
probability measure on T. Write /i = {nkjkm- We say that sequence of T-valued 
random variables (Xfc)fcgN defined on some probability space (17, J^, P) solves the 
stochastic equation associated with /i if 

P[/(Xfe) I {X,),yk\ = I fiXk+1 + Z) ^lk{dz) 

Jt 

for all bounded Borel function / : T — > E, where we use the notation P[- 1 •] for 
condition expectations with respect to P. In other words, if for each A; € N we 
define a T-valued random variable Zk by requiring 

(1-1) Xk—Xk+i + Zk, 

then {Xk)keN solves the stochastic equation associated with fj, if and only if for all 
A: S N the distribution of Zk is /ife and Zk is independent of {Xj)jyk- 

Yor addressed the existence of solutions {Xk)k£N that are strong in the sense that 
the random variable Xk is measurable with respect to cr((Zj)j>fc) for each fc e N; 
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that is, speaking somewhat informally, a solution is strong if it can be reconstructed 
from the "noise" (Zj)jgN without introducing additional randomness "at infinity." 
It turns out that strong solutions exist if and only if 

n 

lim lim I I 

for all /i e Z or, equivalently. 



< oo. 



Yor's investigation was extended in |AUY08| , where the group T is replaced by 
an arbitrary, possibly non-abelian, compact Hausdorff group. As one would expect, 
the role of the the complex exponentials exp(27rz/i-), /i G Z, in this more general 
setting is played by group representations. Interesting new phenomena appear when 
the group is non-abelian due to the fact that there are irreducible representations 
which are no longer one-dimensional. Several of the results in |AUY08| are framed 
in terms of properties of the set of extremal solutions (that is, solutions that can't 
be written as mixtures of others), and the structure of such solutions was elucidated 
further in |HY10) . 

We further extend the work in [Yor92| IAUY08] by considering the following more 
general set-up. 

Fix a sequence {Gk)keN of compact Hausdorff groups with countable bases. Sup- 
pose for each fc e N that there is a continuous homomorphism (pk '■ Gk+i — > Gk- 
Define a compact subgroup H C G := HfeeN ^fc t>y 

(1.2) H := {g = {gk)keN e G : gu ^ 0fe(5fe+i) for all k € N}, 

For example, if we take Gfe = T for all /c e N, then the homomorphism (pk is 
necessarily of the form (t>k{x) = NkX for some Nk £ Z and 

H = {g= [gk)ken e G : gk = Nkgk+i for all k e N}. 

For a more interesting example, fix a compact group abelian group F, put Gk ■— 
Gi^k X G2,fc-i • • • X Gfc^i, where each group G^j is a copy of F, and define the 
homomorphism (j)k by 

4>kigi,k+i,92,k, ■ ■ ■ ,5/c+ia) ■= igi,k+i + g2,k,g2,k + ga.k-i, ■ ■ ■ ,gk,2 + gk+i,i) 

(where we write the group operation in F additively). Note that in this case H 
is isomorphic to the infinite product F^, because an element h = (/iij)(ij)eNxN 
is uniquely specified by the values (/ii,i)ieN and there are no constraints on these 
elements. The following pictures shows a piece of an element of H when F is the 
group {0, 1} equipped with addition modulo 2. 



exjp{2TTihx) iii{dx) 



> 



E 



exp{27rihx) fik{dx) 
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Assume for each fc g N that /i^ is a Borcl probabihty measure Gk and write 
M = (Mfc)fceN- We say that sequence of random variables (Xfe)fegp} defined on some 
probabihty space (fi, P), where Xk takes values in Gk, solves the stochastic equa- 
tion associated with fi if 



P[f{Xk) I {X/) 



j)j>k\ 



f{(pkiXk+i)z) fik{dz) 



for all bounded Borel function / : Gfc — >■ K. In other words, if for each fc € N we 
define a -valued random variable Zk by requiring 

(1-3) Xk = (f)k{Xk+i)Zk, 

then {Xk)keti solves the stochastic equation if and only if for all fc e N the dis- 
tribution of Zk is fik and Zk is independent of {Xj)j^k- In particular, if (Xk)kGN 
solves the stochastic equation, then the sequence of random variables {Zk)keN is 
independent. 

Certain special cases of this set-up when = F, fc e N, for some fixed group 
r and (jjk = k € N for a fixed automorphism -tjj : T ^ T were considered in 
[Tak091 [RaITTl . 

Note that whether or not a sequence {Xk)kGN solves the stochastic equation 
associated with /i is solely a feature of the distribution of the sequence, and so we 
say that a probability measure on the product group OfeeN is a solution of the 
stochastic equation if it is the distribution of a sequence that solves the equation 
and write Vfj. for the set of such measures. 

In keeping with the terminology above, we say that a solution {Xk)ki£N is strong 
if Xk is measurable with respect to a{{Zj)j>k) for each k G N. Note that whether 
or not a solution is strong also depends only its distribution, and so we define 
strong elements of in the obvious manner and denote the set of such probability 
measures by 7?^f°ng. 

Because applying the homomorphism <j)k to X^+i can degrade the "signal" 
present in Xk+i (for example, (j^k need not be invertible), the question of whether or 
not strong solutions exist will involve the interaction between the homomorphisms 
{4>k)keN and distributions {iJ.k)keN of the noise random variables and it introduces 
new phenomena not present in [Yor921 lAUYOSj . 

An outline of the rest of the paper is as follows. In the Section[2]we examine the 
compact, convex set of solutions and show that strong solutions are extreme points 
of this set. We show that the subgroup H acts transitively on the extreme points of 
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the set of solutions and we relate the existence of strong solutions to properties of 
the set of extreme points. In Section[3l we obtain criteria for the existence of strong 
solutions in terms of the the representations of the group Gk and the correspond- 
ing Fourier transforms of the probability measures /ife . In Section |3l we determine 
the relationship between the existence of strong solutions and the phenomenon of 
"freezing" wherein almost all sample paths of the random noise sequence agrees 
with some sequence of constants for all sufficiently large indices. Finally, in Section 
[5] and El respectively, we investigate the example considered above of random vari- 
ables indexed by the nonnegative quadrant of the two-dimensional integer lattice 
and another example where each group Gk is the two dimensional torus and each 
homomorphisms (pk is a fixed ergodic toral automorphism. 

2. Extreme points of V^^ and strong solutions 

It is natural to first inquire whether is non-empty and, if so, whether it 
consists of a single point; that is, whether there exist probability measures that 
solve the stochastic equation associated with /i and, if so, whether there is a single 
such measure. The question of existence is easily disposed of by Proposition 12.11 
below. Note that because the group G = JlfceN compact and metrizable, the 

set of probability measures on G equipped with the topology of weak convergence 
is also compact and metrizable. 

Proposition 2.1. For any sequence /i, the set is non-empty. 

Proof. Construct on some probability space a sequence {Zk)keK of independent 
random variables such that Zk has distribution fi^- For each iV G N, define random 
variables x[^^ , . . . , x'^_^^ recursively by 

eN+i identity in Gn+i 

and 

) = Mxi+l)Zk, l<k<N, 

so that for 1 < A: < iV the random variable (l>k{xl!J\)^^ xjf^^ has distribution fik 

and is independent of xj^^l, xj^^l, . . . , x'}^\ 

Write Pat for the distribution of the sequence {x[^\ . . . , x'^\eN+i,eN+2, ■ ■ •)■ 
Because the space of probability measures on the group IlfeeN ^fc equipped with 
the weak topology is compact and metrizable, there exists a subsequence (A^ri)nGN 
and a probability measure Poo such that Vn„ Poo weakly as ti — > oo. It is clear 
that Poo e T'^. □ 

The question of uniqueness (that is, whether or not ^V^, — 1) is more demanding 
and will occupy much of our attention in the remainder of the paper. 

As a first indication of what is involved, consider the case where each measure fik 
is simply the unit point mass at the identity Cfc of Gk- In this case {Xk)keK solves 
the stochastic equation if X^ = 4'k{Xk+i) for all fc e N. Recall the definition of 
the compact subgroup H <Z G :— YlkeN^k from (|1.2p . It is clear that "P^ coincides 
with the set of probability measures that are supported on and hence = 1 
if and only if H consists of just the single identity element. Note that if > 1 
and {Xk)keN is a solution with distribution P G Vfx that is not a point mass, then 
Xk is certainly not a function of (Zj)j>k = {ej)j>k and the solution {Xk)k&i is 
not strong. Moreover, the probability measures P G that are distributions of 
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strong solutions {Xk)kefi are the point masses at elements of H and Vp, is the closed 
convex hull of this set of measures. 

An elaboration of the argument we have just given establishes the following 
result. 

Proposition 2.2. // H is non-trivial (that is, contains elements other than the 
identity), then Vi_i \ 7?^''°"g ^0. In particular, if H is non-trivial and i^V^ = 1, 
then 7'f*™"s = 0. 

Proof. Suppose that all solutions are strong. Let {Xk)kGN be a strong solution. 

By extending the underlying probability space if necessary, construct an H- 
valued random variable {Uk)keN that is independent of {Xk)keN and is not almost 
surely constant. Note that {Uk)keN is not cr((Xfc)fegN)-ineasurable and hence, a 
fortiori, {Uk)k€N is not CT((Zfc)fcgN)-ineasurable. 

Observe that 

4'kiUk+iXk+i)Zk = 4)k{Uk+i) 4)k{Xk+i)Zk = UkXk, 

because (j)k{Uk+i) = Uk for all A; S N by definition of H. Hence, {UkXk)kGN is also a 
solution. Thus, {UkXk)km is a strong solution by our assumption that all solutions 
are strong. In particular, UkXk is a{{Zj)j > fc)-measurable for all fc S N. However, 
Uk = {UkXk)X^ is (T((Zj)j>fc)-measurable, and we arrive at a contradiction. □ 

Remark 2.3. Consider the particular setting of |AUY08] . where Gfc = F, fc G N, for 
some fixed group F, each homomorphism 0^ is the identity, and H = {{g,g, . . .) : 
g e F}. In this case, one can choose the sequence {Uk)km in the proof of Propo- 
sition 12.21 to be {U,U,- ■ ■), where U is distributed according to Haar measure on 
F; that is, {Uk)kefi is distributed according to Haar measure on H. Each marginal 
distribution of the solution {Xk)ke'N is then Haar measure on Gk = F. In our more 
general setting it will not generally be the case that if {Uk)keti is distributed accord- 
ing to Haar measure on H, then Xk will be distributed according to Haar measure 
on Gk for each fc e N. For example, fix a compact group F, put Gk — F^ for all 
e N and define (j)k : Gk+i Gk by (j)k{9i,92,93, ■ • ■) = idi, 9i, 92, 92, 93, 93, ■ ■ ■) 
for all k & N. It is clear that H = {{{g, g, ...), {g, g, ...),.. .) : g e F}, so that 
{xk : {xi,X2, . . .) G H} C Gk is just the diagonal subgroup {{g, . . .) : g G F} of 
the group Gk- Hence, for example, if fik is the point mass at the identity of Gk for 
each fc G N, the possible solutions {Xk)k£n are just arbitrary random elements of 
H, and it is certainly not possible to construct a solution such that the marginal 
distribution of Xk is Haar measure on Gk for some fc G N. 

From now on, we let Xk : G — > Gfe, A; G N, denote the random variable defined 
by Xk{{xj)jeN) ■= Xk and define Zk : G ^ Gk, fc G N, by Zk := (/)„(Xfc+i)"iXfe. 

Notation 2.4. Given a sequence of random variables S — [Si, S2, ■ ■ ■) and fc G N, 
set J"f := (T{{Sj)j>k). Similarly, set := J'f and J"^ := flfcGN-^f ■ 

Notation 2.5. For any sequence /i ~ {lJ.k)keN, the set of solutions Vfj, is clearly a 
compact convex subset. Let V^^ denote the extreme points of V^. 

Lemma 2.6. A probability measure P G belongs to V^if and only if the remote 
future J-'^ is trivial under P. 

Proof. Our proof follows that of an analogous result in |AUY08j . 
Suppose that P G and the cr-field is not trivial under P. 
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Fix a set A e with < P(A) < 1. Then, 

P(-) = P(yl)P(- 1 A) + (1 - P(A))P(- 1 A""). 

Observe that P(- 1 A) ^ P(- 1 A"), since P(^ | A) = 1 7^ P(A | A") = 0. 
Note for each fc e N and B <Z Gk that 



¥{XkMXk+in eB\A} = 



¥{A) 

^ikiBmA) 



¥{A) 



= ^^k{B) 



because P e T'p and hence Xk (j)k{Xk+i) ^ is independent of under P. Similarly, 



P{{Xk MXk+i)-' eB}nc\A) 



^lk{B)ncnA) 



= P{Xk MXk+i)-^ e B I A}¥{C I A) 



Thus, P(- 1 A) £ V^. The analogous argument establishes P(- | A'=) e Vf,. Since 
P(- 1 A) ^ P(- 1 A"), the probability measure P cannot belong to V^"". 

Now assume that P e and is trivial under P. To show P is an extreme 
point, it suffices to show that if P' e is absolutely continuous with respect to P, 
then P = r. 

Note that a solution X is a time-inhomogeneous Markov chain (indexed in back- 
wards time with index set starting at infinity) with the following transition proba- 
bility: 

F{Xk e A I Xk+i} = e Gk ■ MXk+i)9 e A}. 

Since P and P' are the distributions of Markov chains with common transition 
probabilities and P' is absolutely continuous with respect to P, it follows that for 
any measurable set A the random variables F{A\J^^) and P'(A| J"^) are equal 
P-a.s. Because is trivial under both P and P', it must be the case that F{A) = 

r{A). □ 



cx 

/J ■ 



Corollary 2.7. All strong solutions P £ Vfj, are extreme; that is, 'p^''°'^s c 

Proof. By definition, if P e T'^ is strong, then Xk <E for all fc e N. Thus, 
^k = ^k foi" all fc e N and hence ^ F^. The last cr-field is trivial by the 
Kolmogorov zero-one law. □ 

Remark 2.8. There can be extreme solutions that are not strong. For example, 
suppose that the = F, fc S N, for some non-trivial group F, each (pk is the 
identity map, and each /i^. is the Haar measure on F. It is clear that consists 
of just the measure ^^eM t'-^ (that is, Haar measure on G), and so this solution is 
extreme. However, it follows from Proposition 12.21 that this solution is not strong. 



It is clear that if P G and h = {hk)keti G H, then the distribution of the 
sequence {hkXk)k&N also belongs to P e V^. Moreover, if P e T'™, then it follows 
from Lemma 12.61 that the distribution of the sequence {hkXk)ki£N also belongs to 
V^^. Similarly, if P g 'p^'^ong^ ^^len the distribution of the sequence {hkXk)k(^N also 
belongs to ■p^*''°"g. We record these observations for future reference. 
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Lemma 2.9. The collection of maps Th '-Vp, ^ V^, h £ H, defined by Th{F){-) = 
F{{hkXk)ken € •} constitute a a group action of H on Vfj,. The set of extreme 
solutions and the set •p^t''°"s of strong solutions are both invariant for this action. 

It follows from the next result that either "pf °ng = or °ng = p'-'^. For the 
purposes of the proof and later it is convenient to introduce the following notation. 

Notation 2.10. For fc,£ e N with k < I, define 4>i:Gt^ Gu by 

4'k=4>kO 4>k+\ o • • • o 
and adopt the convention that (j)'^ is the identity map from Gk to itself. 
Theorem 2.11. The group action {Th)heH is transitive onV^. 

Proof For k G N, define : UkeniGi^- x Gk x Gk) ^ Gk (resp. X'^ : UkeniGk x 
Gk X Gk) Gk) and Yk : flkeniGk xGkX Gk) Gk) by X'^{{x'j,x'- ,yj)jen) = x',, 
(resp. X'^{{x'j,x'!i,yj)j(zn) = x'l and Yk{{x'^,x'^ ,yj)j<.n) = yk). 

Suppose that P'.P" G V^,. Write P^,(-) (resp. P^'(-)) for the regular conditional 
probability of P'{X g • | Z = z} (resp. P"{X &-\Z = z}). 

Define a probability measure Q on HfeeNl^fc x Gk x Gk) by 

q{{X',X",Y) &A'xA"xB}= f P;(A')P;'(A")1b(^) {(S) f^h){dz). 

•'^ feGN 

By construction, (l)k{X'^+^)-'^ X'^, = (t)k{X'^+i)'^ X'^ = Yk for ah A: G N, Q-a.s., 
the distribution of the pair (X', Y) under Q is the same as that of the pair {X, Z) 
under P', and the distribution of the pair {X'\ Y) under Q is the same as that of 
the pair {X, Z) under P". In particular, the distributions of X' and X" under Q 
are, respectively, P' and P". 

Suppose for some fc € N that $' : G — >■ K and : G — > M are both bounded 
-?^fe^l_i-measurable functions and : — >■ R is a bounded Borel function. Then, 
^'oX' : YljefiiGj X Gj x Gj) ^ M is 7"^ ^ -measurable and o X" : Ujef^iGj x 
Gj X Gj) -> R is J"^^-measurable, and hence, by the construction of Q (using the 
notations and | •] for expectation and conditional expectation with respect 
to a probability measure v), 

Q[$' o X' $" o X" I J-^] = Q[$' o X' I T^] o X" I J-^] 
= PV[$'oX] P^[$"oX] 

is J-'^_^_i-in.ea.smah\e. Thus, by the construction of Q and the independence of the 
elements of the sequence {Yj)j^^ under Q, 

Q[$' o X' o X" * o Yk] = Q[Q[$' o X' o X" * o I T^]] 

= Q[Q[$' o X' o X" \J^^]^o Yk] 
= Q[¥'y[^' o X] P^[$" o X]] Q[* o Yk] 
= Q[$' o X' o X"] Q[* o Yk]. 

Therefore, by a standard monotone class argument, Yk is independent of J^k^i''^ ^ ■ 

(X' X") 

Consequently, the sub-cr- fields and J^So ' are independent. 



8 



STEVEN N. EVANS AND TATYANA GORDEEVA 



Suppose now that ¥' ,F" e V^^"". Observe for < n that 



(2.1) 



n-1 



m—k 



n-1 



m — k 



a.s. 



^rkix'^)rkix':r\ 



and so there exists a G-valued random variable W £ J-^ such that Wk — 
X'i^{X'f!)~^ , Q-a.s. From the above, W is independent of the sub-cr-field J-y- By 
construction, W takes values in the subgroup H . 

Let Q{-\W = h) he the regular conditional probability for Q given W ^ h E H, 
so that 



(2.2) Q(-)= / Qi- \W ^h)Q{W edh}. 

J H 

It follows that 

Q{X^ = c^k{X'k+,)Yk, Vfc e N I = /i} = 1 
for (Q{T^ e dft,}-almost every h & H. Moreover, because W is independent of J"y 
it follows that Q{Y G •} = Q{Y e ■ \ W ^ h} ^ ^kefit^k '^{^ ^ dft.}-almost 
every h e H. Thus, Q{X' e ■ \ W =^ h} e for Q{e e rf/i}-almost every h e H 
and, by (lO) . 

P'(-) = Q{X' e •} = / Q{X' e • I T4^ = /i} Q{Ty e d/i}. 
Jh 

This would contradict the extremality of P' unless 

¥'{■) = Q{X' e-\W ^h}, for Q{Ty e d/i}-almost every G 7J. 
Similarly, 

P"(-) = Q{X" e-\W = h}, for Q{W e d/i}-almost every /i e i7. 
By (EU, 

= /ifeXfe Vfc e N I W = /i} = 1, for G d/i}-almost every heH. 

Therefore, 

P' = T,i(P"), for Q{W e d/i}-almost every heH. 

□ 

Notation 2.12. Given P^ e V-^^, let ij;^'^'^(P") := {h e H : Th{F°) P"} be the 
stabilizer subgroup of the point P" under the group action {Th)heH- 

Remark 2.13. It follows from the transitivity of H on that for any two proba- 
bility measures P',P" G V-^ the subgroups i/^*^'"(r) and i/^*^''(P") are conjugate. 

Corollary 2.14. A necessary and sufficient condition for ^f^V^i = 1 is that 

Proof. This is immediate from Theorem 12.111 and the observation that = 1 if 
and only if #7^,^ = 1. □ 

Corollary 2.15. If H^'^^{P'^) is non-trivial for some, and hence all, P° G V^^, 
then Pfons ^ 0. 
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Proof. As we observed prior to the statement of Theorem I2.1H it is a consequence 
of that rcsuh that either "P^^t^ng = or "pstrong ^ ^cx^ 

Suppose that P° e -p^trong jg g^^Yi that 7?;^'''^(P°) is non-trivial. By working on 
an extended probabiUty space, we may assume that there is an 7?j^'^'^(P°)-valued 
random variable (Uk)ki£fi that is independent of {Xk)keN and is not almost surely 
constant. The distribution of the solution (UkXk)keti is also and, in particular, 
this solution is strong. However, this implies that 

<j{UkXk) C a((0,(C/,+i U, Xj),>k) 

^a{{<P,{X,+,)-^X,),>k) 

— -f^ k 

for all /c e N, and hence Uk is J^^-measurable for all A; G N, because Xk is T^- 
measurable by the assumption that P° G -pstrong^ However, because the sequence 
(C^fc)fceN is independent of the sequence of {Xk)k&\ and not almost surely constant, 
it follows that that {Vk)k&i is not cr((Xfc)fegN)-iiieasurable, and hence a fortiori 
{Uk)km is not (T((Zfe)fcgN)-nieasurable. We thus arrive at a contradiction. □ 

3. Representation theory and the existence of strong solutions 

Notation 3.1. Let Q be the set of all unitary, finite-dimensional representations 
of the compact group G = YikeN ^k- 

Any irreducible representations of G is equivalent to a tensor product represen- 
tation of the form 

(gfe)feeN p^'^'Hsfei) «) • • • «) p'^'^-HgkJ, 

where {ki,...,kn} is a finite subset of N and p('^j) is a (necessarily finite- 
dimensional) irreducible representation of Gkj for 1 < j < n. Furthermore, an 
arbitrary element of G is equivalent to a (finite) direct sum of irreducible represen- 
tations. 

Notation 3.2. For k E N write : Gk ^ G for the map that sends h E Gk 
to (ei, . . . , Ck-i, h, Cfe+i, . . .), where, as above, ej is the identity element of Gj for 

Consider an arbitrary representation p E Q. It is clear from the above that if 
P E p^t™"g, then p o ik{Xk) is J"f -measurable for all fc e N. Note that p o is 
a representation of Gk and all representations of Gk arise this way. On the other 
hand, because, by the Peter- Weyl theorem, the closure in the uniform norm of the 
(complex) linear span of matrix entries of the irreducible representations of Gk is 
the vector space of continuous complex- valued functions on G^, it follows that if 
po tk{Xk) is J^^-measurable for all fc G N for an arbitrary representation p E G, 
then P G 'P^''°'^s_ This observation leads to the following definition and theorem. 

Notation 3.3. Set 

^strong ;^ {p (= g ; 3P (= -p^^ such that poLkiXk) IS J"f -measurable P-a.s. Vfc G N} 

Theorem 3.4. The set p^^^s of strong solutions is non-empty (and hence equal 
to V;^) if and only = 
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Proof. The result is immediate from the discussion preceding the statement of the 
theorem once we note that if P' and P" both belong to then, by Theorem [2TTT1 
there exists h G H such that P" is the distribution of hX — {hi,Xk)keti under 
P' and so p o is J^^-measurablc P"-a.s. if and only if p o Lk{hkXk) is F^- 

measurable P'-a.s. (recall that Z^. — (t){Xk^i)^^ X^ ~ (j>{hkXi,^i)^^ h^Xk when 
h G H); therefore, poLk{Xk) is J"^-measurable P"-a.s. if and only if [poLk{hk)\ [po 
ife(Xfe)] is /"^-measurable P'-a.s., which is in turn equivalent to p o Lk{Xk) being 
J^^-measurable P'-a.s. by the invertibility of the matrix po Lk{hk). Thus, 

.^strong = {p (= g . po tk(Xk) is J-f -measurable P-a.s. Vfc G N } 

for any P G 'P^''. □ 

Theorem 13.41 is still somewhat unsatisfactory as a criterion for the existence of 
strong solutions because it requires a knowledge of the set V^^ of extreme solutions. 
We would prefer a criterion that was directly in terms of the sequence (pfe)fegN- In 
order to (partly) remedy this situation, we introduce the following objects. 

Notation 3.5. Fix peQ. For A:, ^ e N with k < £, set 

/ po ik° (l>i{z) Hi{dz). 

JGi 

Let 

^u" {p e g : lim lim |det(i?;'i?"-i • • • > V/c £ N} 

and 

■={P^G- lim lim ||i?^i?r ' • • • K\\ > Vfc € N}, 

^ m— foo n— >oo 

where || • || is the operator norm on the appropriate space of matrices. 

Proposition 3.6. Fix PeVf,. 

(i) IfpeU'l'^K then 

P[p o ife(Xfe) I V J-f ] = p o ik{Xk) 

for all A; G N. In particular, ifPE 'P'jj^, then po bk{Xk) is F^ -measurable 
for all /j e N. 

(ii) If piW'°"'', then 

P[poifc(Xfe)|J-^VJ-f] = 

for some fc G N. In particular, if P E 'P'jl^> then po ik{Xk) is not - 
measurable for some G N. 

Proof. The proof follows that of an analogous result in |AUY08) with modifications 
required by the greater generality in which we are working. 

Consider claim (i). Fix p G "H^"* and /c G N. For £ > k we have 

(3.1) pOLkiXk) = po LkO (l>l{Xi) pOLk O cf)]r^{Z(-l) ■■■ po LkO (f>k{Zk). 

For k < m < n put 

S™ := p o o 0;'(Z„) ■■■poL,o C(^m)- 

Note that 

p[s™] = i^^..i^I^ 
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For any p> k, the matrix p o Lk o (f>^^ is unitary, and so ||p o tfc o — 1 for all 

h e Gp. By Jensen's inequality, ||i?^|| < 1. In particular, | det(i?^)| < 1. Hence, 

lim lim |det(P[2™])| 

m— >-oo n— >cxD 

exists and is given by 

sup inf |det(i?^)|..-|det(i?|r)|. 

m ri>m 

Moreover, there are constants e > and M £ N such that |det(P[S™])| > e 
whenever n > m > M. It follows from Cramer's rule that the matrices P[S™] are 
invertible with uniformly bounded entries for n > m > M. 

Set $™ := P[S™]^^S™ for n > TO > M. The matrices $™ have uniformly 
bounded entries and 

p I aiiZj,);^^)] = 

so that {^n)n>m IS & bouudcd matrix-valued martingale with respect to the fil- 
tration {a{{Zp)p^^))n>m- Thus, hm„^oo 'i'™ —■ exists and is J"^-measurable 
P-a.s. for each to > M. Consequently, lim„^oo —: S™ also exists and is 
J^^-measurable P-a.s. for each to > M. Part (i) is now clear from p.ip . 



Now consider part (ii). Fix p 



and fc e N such that 



lim lim 

m— ^cx3 n— )-oo 



'^■■■Rk\\ =0. 



R 



.m+l 



It follows from ()3.ip that for n > m > A: 

P [p o tfe(Xfe) I V ,.)] = p o o <^^(X„)i?r' 

po Lk° 4>m{Zni) ■■ ■ po LkO 4>kiZk)- 

Since p{g) is a unitary matrix for all g € G, the norm of the right-hand side is at 
most • • • which, by assumption, converges to as n — J' oo followed by 

TO — > oo. Thus, by the reverse martingale convergence theorem and the martingale 
convergence theorem, 

P [p o Lk{Xk) I V J-f ] = hm lim P [p o ck{Xk) \ V r7((Z,)™ ,)] = 0. 



m^oc n— ^oo 



□ 



The following result is immediate from Theorem 
Theorem 3.7. The following containments hold 

.^norm ^strong — ^ ^dct 



and Proposition 



^ g implies that 7?-^t™ng = 



Thus, nf^ = g implies that 7?;^t™ng ^ and W^"""" , =, „..„^.„„„ , ^ 

The following is a straightforward equivalent of Theorem 13.71 and we omit the 
proof. 



Corollary 3.8. // 



lim lim 

m— ^oo n— ^oo 




p o 4)l{z) pt,{dz) 



> 



for all irreducible representations p of Gk for all fc G N, then 7?stiong -^^ ^j 



lim lim 



n 



P ° (t>kiz) Mdz)) 



Ge 
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for some irreducible representation p of Gk for some fc G N, then 7?^t'°"g — 0. 

Under a further assumption, we get a representation theoretic necessary and 
sufficient condition for the existence of strong solutions. 

Definition 3.9. A Borel probabihty measure ^ on a compact Hausdorff group F 
is conjugation invariant if 

f{9~^xg)v{dx) = I f{x)v{dx) 
Jr 

for all 5 € r and bounded Borel functions / : F — ^ K. 

Remark 3.10. Note that if F is abelian, then any Borel probability measure z/ on F 
is conjugation invariant. 

Corollary 3.11. Suppose that each probability measure pk, k G N, is conjugation 
invariant. Then, 



-T/norm -t/ strong ntd 

'^'^ 



/dot 

and 7:'j^trong ^ if and only if each of these sets is Q or, equivalently, 

> 



lim lim 

m— )-oo n— ^oo 



n / X ° (f>i{z) pe{dz) 

n ^ Gp 



for each character x of an irreducible representation of Gk for all k £ N. 

Proof. The result is immediate from Corollary 13.81 and Lemma [3.121 below . □ 

The following lemma is well-known, but we include a proof for the sake of com- 
pleteness. 

Lemma 3.12. If v is a conjugation invariant Borel probability measure on a com- 
pact Hausdorff group F and p is an irreducible representation of F with character 
X, then 



p{x) v{dx) — I x{x) v{dx) X /, 
Jr 

where I is the identity matrix. 

Proof. Let A be the normalized Haar measure on F. By assumption, 

p{x) v{dx) ^ j j P{g~^xg) \{dg) v{dx). 
Now, for X, J/ G F we have 

p{g^^xg) \{dg) p(y) = / p{g'^xgy) \{dg) 



p{yh ^xh) \{dh) 
p{y) I p{h-^xh)X{dh), 



and so the matrix Jp p{g^^xg) \{dg) commutes with the matrix p{y) for all ?/ G F. 
It follows from Schur's Lemma that Jp p(g^^xg) X{dg) = cl for some constant c, 
and taking traces of both sides gives c — xi^)- ^ 
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4. Freezing 

Recall that the Hilbert-Schmidt norm of a matrix A is given by ||A||hs ■— 
tT{A*A)'!, where A* is the adjoint of A (this norm is also called the Frobenius 
norm and the Schur norm). Write d{p) for the dimension of a unitary representation 
p & G, and note that |lp(a;)|||f^s — tr(J) = d{p). If is a probability measure on G, 
then II p{x) i^{dx)\\'jjg < d{p) by Jensen's inequality. 



Notation 4.1. Set 



d{p)- 



P O ik O (l>l\z) p,yn{dz) 



HS 



< cx) V/c e N 



Proposition 4.2. The sets and W^^^ are equal, and so = Uf^ = Q 

implies that 7?^trong _^ 0^ Moreover, if each probability measure pk, k € N, is 
conjugation invariant, then, 



'T/norm -t/ strong -T/dct freeze 

'^fi '^fi '^fi 



and p^t™"g $ if and only if each of these sets is Q or, equivalently, 



lim lim 

m— ^oo n— >oo 



> 



for each character x of an irreducible representation of Gk for all fc G N. 



Proof. It suffices to show that 'H^^'^°^° — because the remainder of the result 

will then follow from Theorem 13.71 and Corollarv l3.11l 

Fix p £ Q. Write < A^(l) < • • • < Xl.{d{p)) for the eigenvalues of the matrix 



p{z)pf^{dz) / p{z)p^{dz) 

Gk J \JGk 
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Observe that 



n ^ 

lim lim 1 [ det / p{z) ^^^.{dz) 



> 



n „ 

lim lim If det / p{z) ^^^{dz) 

1) ^ 



> 



lim lim l[\iil)---\iid{p))>0 



^[(l-Ar(l)) + ... + (l-Ar(rf(p)))]< 



£ M(p)-(Ar(l)) 



AI"(d(p)))] < oo 



E 

m—k 



dip) 



/9 tfc O (j)^ [z) pra{dz) 



HS 



< OO, 



as required. 



□ 



Given Proposition l4.21 the reader may wonder why we introduced the set 'Hy''''^''. 



The equivalence established in Proposition 14.21 makes the proof of the following 
result considerably more transparent. 



Proposition 4.3. Suppose that each group Gk, k £ N, is finite. Then, % 



det 



^freeze g fj^^fj^ Qjiiy if for some (equivalently, all) P G there are constants 
Ck,m G Gk, k,m € N, k < m, such that 

P{C(^m)^Cfc,™i.O.}=0 

for all fc e N. 

Proof. Write /i™ for the probability measure on Gk that is the push-forward of the 
probability measure fim on Gm by the map 0™ : Gm — >■ Gk ■ For simplicity, we write 
p^fig) instead of p'^Hg}) for g e Gk. It is clear that P{^^(Z„) ^ Cfe,„i.o.} ^ 
k < m for all A: G N for some family of constants Ck,m € G^, fc, m e N, if and only 
if P{(j)^{Zm) 7^ Cfc m i-o.} = where ^ is any family with the property 

M(cfe,m) = max{/i^(5) : g € Gk} 
and, by the Borel-Cantelli lemma, this in turn occurs if and only if 



for all fc e N. 
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Now, 



1/2 



By Parseval's equality, 



geGfc 



peGfc 



HS 



and hence 



\ peGfc 



seGfc 



E ^(5)^^(5) 



1/2 



Note for a sequence of constant (a„)„gN C [0, 1] that X]neN(l ~ '^n) < 00 if and 
only if X)neN(l ~ < oo- Note also that 

pGGfc 



Thus, 



for all fc e N if and only if 



E A*(G''A{4,m}) < 00 



P^Gk 



m—k 



d{p)- 



HS 



< 00 



for all fc € N, which is in turn equivalent to 

d{p) 



E E 

™='=peGfc 



E /'C9)A^r(.9) 



HS 



< 00 



for all p g Gfc for all fc e N. 

A decomposition of the representation poLk of for some p E G into irreducibles 
shows that the last condition is equivalent to the one in the statement. □ 

Remark 4.4. It follows from Proposition 221 and Proposition 231 that if each group 
G/c, fc e N, is finite and for some (equivalently, all) P S T'^ there are constants 
Ckm G Gfc, fc, m S N, k < m, such that 



\Zm) 7^ Ck,m i.O.} = 
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for all e N, then TJ^t'o^s ^ 0. Moreover, these two conditions are equivalent when 
each probability measure /i^, A; G N, is conjugation invariant. Also, for the special 
case when Gk = F, fc e N, for some fixed finite group T and each homomorphism 
(/)/-: r —> r is the identity, it follows from Corollary 2.6 of [HYlOj that the two 
conditions are equivalent. It would be interesting to know the status of the reverse 
implication in general. 

5. Groups indexed by the lattice 

Recall from the Introduction the example of our general set-up where Gk '■— 
Gi^k X G2,k-i • • • X Gk,i with each group Gij a copy of some fixed compact abelian 
group r and the homomorphism is given by 

<l>k{gi,k+i,g2,k, ■ ■ ■ ,gfe+i,i) (5i,fe+i + g2,k,g2M + ga.k-i, ■ ■ ■ ,3/0,2 + 5fe+i,i)- 

We will consider the particular case where T is Zj,, the group of integers modulo 
some prime number p. 

Because Zp is abelian, all its irreducible representations of G are one-dimensional. 
The irreducible representations are the trivial one and those of the form p(g) ~ 

U.n=i for some m, pairs ji), . . . , (imjm) e and 1 < z„ < 

p-1. 

The homomorphism 0^ maps (gij, ■ ■ ■ G Gg to {hij., . . . , hk^i) G Gk where 



hi,k+l-i — ( . \gi+jj+l-i-j G Zp. 

Set /(m, n) :— (™) mod p. When we restrict to Gk, the representation p o Lk 
is of the form HiLi ^^P {~f^gi,k+i-ij with < <p — I. We therefore need to 
evaluate 

n n "^^P ( 'f^^ ~ k^j)9i+j,{+i-i-3 ) Mdge) 

to determine whether or not 'p^'^°'^s — 0. The following theorem of Lucas (see 
[Gra97j ) gives the value of /. 

Theorem 5.1. Letm,n be non-negative integers and p a prime number. Suppose 



and 
Then, 



k 

m = nrikP + . . . + mip + mo 



n = UkP*' + . . . + nip + no. 



m \ 1 r / rn. 

n 



Equivalently, if mo and no are the least non-negative residues of m and n mod p, 
then C) = (K)0. 

Rather than use Theorem 15.11 directly to construct interesting examples, we 
consider a consequence of it for the case p ~ 2. Suppose that pk = Mi,fc ® ■ ■ ■ ® Mfe,i 
where pi^k+i-i{^} = T^fc = 1 ~ /ij,fc+i_i{0} for some < tt^ < 1. 
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Define x = {xm,£+i-m)m=i e = Gi,£ x • • • x Gi^i = Z| by 



where the arithmetic is perforraed modulo 2 and e^"^'^^-^ G is the vector with 
e'-^f+iSZ^ = 1 and eg'+t-^"^ = torn ^ m. Then, 

/ n n (— /(^ - fc, Mdgi) = (1 - 2^,)*'^('=^^^^), 

where 

M(/c, e,z):=#{l<m<e: Xm,i+i^m = I}- 
Observe that if Xm,i+i-m — 1, then 

3=0 

for some 1 < i < k with = 1. Now 

#{1 < m < ^ : E/(^- ^,j)eS^i''-„r^'^ = 1} 

= #{1 <m<e: f{e-k,m-i) = l,i<m<i + e-k} 
= ^{i < m < i + e - k : f{i - k,m - i) ^ 1} 
= #{0 < m < ^ - fc : /(£ - A:, m) = 1}. 

As remarked in |Gra97j , a consequence of the following theorem of Kummer from 
1852 that the number of the binomial coefficients (™), < n < m, which are odd 
is 2^(™), where N{m) is the number of times that the digit 1 appears in the base 
2 representation of m. 

Theorem 5.2. Let m,n be non-negative integers and p a prime number. The 
greatest power of p that divides (™) is given by the number of "carries" that are 
necessary when we add m and n — m in base p. 

Thus, 

M{k,i,z) < k2^^^-^^ 

and M(fc, z) = 2^(^-'=) when #{1 < i < /c : = 1} = 1. 

Therefore, if we assume 7r„ — > as n — > cxd, then we are interested in whether 



lim TT(l-27r;,+,)2""'' ^0 



2N(r 

r=l 

for all /i e N or, equivalently, whether 

oo 

^2~('-V,+, <cx3 

r=l 

for aU /i e N. 
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For example, fix a positive integer a and an increasing function 6 : N — > N 
such that a < b{jn) < m and liuim^oc b{m) — oo. Suppose that 7r„ = unless 
2™ + 2''(™) - 2" < n < 2™ + 2''(") for some m e N. Note for any e N that 



E 



1 s=fe+l 



and this sum is finite if and only if 

oo 

^2''('°S2")7r„ 

n=l 

is finite. 

Thus, p;^t™"g ^ if and only if X^JT^i 2''^'°S2 »)7r„ < oo in this case. On the 
other hand, V{Zk ^ Oi.o.} > (equivalently, P{Zfe ^ Oi.o.} = 1) if and only 
if X^J^i ^'"'n Therefore, when lim,„_j.oo m — 6(m) = oo it is possible to 

construct (7r„)„gN such that almost surely infinitely many "bits" are "corrupted" 
and yet strong solutions still exist. 

6. Automorphisms of the Torus 

Consider the torus group = M? /I? . We write an element x G as a column 
vector X = {xi,X2)^ G [0, 1)^, where T denotes the transpose of a vector. 

Any 2x2 Z- valued matrix S defines a homomorphism x i— ^ Sx from to itself if 
we do ordinary matrix multiplication modulo 1? . If the matrix S has determinant 
1, then this homomorphism is invertible. Such a transformation is called a linear 
toral automorphism. 
Note that if 

'a 

. c dj 



S 



then the eigenvalues of S are 

^{a + d± Va^ + 4be~2ad + d^) = ^{a + d± VTaTdp"!), 

Thus, the eigenvalues are real and distinct unless a + d is 0, ±1 or ±2, in which 
case the pairs of eigenvalues are, respectively {±i}, {i(l ± iVS)}, {^(—1 ± *V^)}, 
{1,1}, and {—1,-1}. Note that in each of the latter cases the eigenvalues lie on 
the unit circle. 

Definition 6.1. A ergodie toral automorphism is a linear toral automorphism given 
by a matrix S with no eigenvalues on the unit circle. 

For some of the more probabilistic properties of ergodie toral automorphisms, 
see [Kat71j . Such mappings are the prototypical examples of Anosov systems that 
have been the subject of intensive study dynamical systems world (see [Fra69j ). 

A hyperbolic linear toral automorphism has two real eigenvalues Ai > 1 > Aj~^ = 
A2. These eigenvalues are irrational and the corresponding (right) eigenvectors 
and have irrational slope (see, for example Section 5.6 of |LT93| ) . 

Theorem 6.2. Suppose for every i €: N that the group Gi is a copy of and 
that the homomorphism 4>i is a fixed ergodie toral automorphism given by a matrix 
S. Suppose the noise distribution fik is a fixed measure jjL* that satisfies ^J*{A) > 
e\{A n B) for every Borel set A, where e > 0, A is normalized Haar measure, and 
B IS a fixed Borel set B with X{B) > 0. Then, = 0. 
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Proof. We need to evaluate — p ■ ■ <t>ki'^) l^^i'^'^) ■ ^et v be the measure 
defined by v{A) — e\{A n B) a Borel set A, where e, A and B are as in the 
statement. Observe that 

\Ri\ < [ \p-Lk- 4(^)1 (pi ~ v){dz) + [ \p-tk- Hdz)\ 

p- ik- (t)i{z)v{dz) 



< / {pe-v){dz) + 



and note that the last term on the right-hand side is |/^2 P • f-kiz) {u ■ (^f.) 

As noted in Section 5.6 of |LT93j . any ergodic toral automorphism S ex- 
hibits topological mixing: for any Borel sets A,B C R^, lim„^oo ^^^^^^y^ = 
X{A). Because (/)| is a ergodic toral automorphism, so is {<i>k)~^ ■ Therefore, 
Vmii^oo \ Sf2 P ■ i'k{z){v ■ 4)'j^)^^{dz)\ = \J^2 P ■ i'kiz)eX{dz)\ = 0. Consequently, 
l-Rfel ^ Jj^ifJ-e — i'){dz) = 1 — eA(i3) for every non-trivial representation p, and 
hence 

lim lim \RIRI'^ ■ ■ ■ RT\ = V/j e N, 

m— >-oo n— )-C50 

showing that ^^^'^"s = 0. □ 
Every finite-dimensional unitary representation of Gi is of the form, 

where z is a vector (zi, Z2) G and z • a; is the usual inner product. Hence, if we 
lift this representation to a representation of G we have 

Rl= [ e"-^^^-''""^^ p,{dx). 

Suppose that the probability measure pe is concentrated on the set of multiples 
of the eigenvector associated with the eigenvalue A2 £ (0, 1). Then, 

Jr 

for some probability measure vi on M. It is clear that under appropriate hypotheses 
lim lim |i?^-RT^ • • • > Vfc e N 



and hence, by Corollary [SH Vf,^'°"^ ^ 0. For example, if i^e ^ v for all ^ G N for 
some fixed probability measure v on M, then it suffices that \t\ v{dt) < 00. In 
particular, it is possible to construct examples where yiti = /X2 = . . . is a measure 
that has all of as its closed support and yet ""s ^ 0. 
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